Papers with Deep Neural Networks
Layerwise Relevance Visualization in Convolutional Text Graph Classifiers (D19-53)
Copied to clipboard
| Challenge: | Existing explainability methods do not focus on intermediate states in hidden layers of Deep Neural Networks (DNNs). |
| Approach: | They propose a method that visits visible and hidden layers of a deep neural network and projects them onto the interpretable domain. |
| Outcome: | The proposed method yields meaningful layerwise explanations for a GCN sentence classifier. |
Arabic Synonym BERT-based Adversarial Examples for Text Classification (2024.eacl-srw)
Copied to clipboard
| Challenge: | Often, research studies quantifying the impact of adversarial text attacks have been applied only to models trained in English. |
| Approach: | They propose a word-level study of adversarial text examples in Arabic . they use a synonym attack with a BERT model to assess their robustness . |
| Outcome: | The proposed attack compares Arabic adversarial examples with their original examples and regains 2% accuracy after training. |
Generating Image Captions in Arabic using Root-Word Based Recurrent Neural Networks and Deep Neural Networks (N18-4)
Copied to clipboard
| Challenge: | Existing studies on image caption generation in English focus on Western languages, ignoring Semitic and Middle-Eastern languages like Arabic, Hebrew, Urdu and Persian. |
| Approach: | They propose to leverage the critical dependency of Arabic to generate Arabic captions using root-word based Recurrent Neural Network and Deep Neural networks. |
| Outcome: | The proposed model outperforms English-Arabic translated captions on a dataset from newspapers in the Middle East. |
Fine-mixing: Mitigating Backdoors in Fine-tuned Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for defending NLP models against backdoors have ignored the clean weights of PLMs. |
| Approach: | They exploit pre-trained weights to mitigate backdoors in fine-tuned NLP models . they use a fine-mixing technique and an Embedding Purification technique to do the same . |
| Outcome: | The proposed method outperforms baseline mitigation methods on three single-sentence sentiment classification tasks and two sentence-pair classification tasks. |
NeuronBlocks: Building Your NLP DNN Models Like Playing Lego (D19-3)
Copied to clipboard
| Challenge: | Deep Neural Networks (DNN) have been widely employed in industry to address various natural language processing tasks. |
| Approach: | They propose an NLP toolkit that encapsulates neural network modules as building blocks to construct various DNN models with complex architecture. |
| Outcome: | The proposed toolkit can build, train, and test various DNN models with complex architecture. |
Integrated Directional Gradients: Feature Interaction Attribution for Neural NLP Models (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for attribution of importance to features borrowed from cooperative game theory . success of Deep Neural Networks has led to their ability to learn from complex higher order interactions from raw features. |
| Approach: | They propose a method for attributing importance scores to groups of features . they propose axioms that any intuitive feature group attribution method should satisfy . |
| Outcome: | The proposed method captures the importance of features in a linguistic model using negations and conjunctions. |
Neuron-level Interpretation of Deep NLP Models: A Survey (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing work on deep neural networks has focused on representation analysis, but recent work focused on analyzing neurons within these models. |
| Approach: | They propose to analyze neural networks to uncover linguistic concepts captured by the network . they propose to use a granular approach to analyze neurons within these models . |
| Outcome: | The proposed method combines methods to discover and understand neurons in a network with evaluation methods. |
Measuring and Mitigating Local Instability in Deep Neural Networks (2023.findings-acl)
Copied to clipboard
| Challenge: | Uncertain details like random initialization can change the outputs of a trained system with potentially disastrous consequences. |
| Approach: | They propose a model stability problem by studying how the predictions of a deep neural network change as a consequence of stochasticity in the training process. |
| Outcome: | The proposed method outperforms data-agnostic methods and is 90% cheaper than the gold standard. |
BadActs: A Universal Backdoor Defense in the Activation Space (2024.findings-acl)
Copied to clipboard
| Challenge: | Backdoor attacks pose an increasingly severe security threat to Deep Neural Networks . existing methods focused on the word space are ineffective against feature-space triggers - a recent study has shown . |
| Approach: | They propose a backdoor defense that purifies backdoor samples in the activation space . they aim to eliminate backdoor triggers while preserving the integrity of clean data . |
| Outcome: | The proposed method achieves state-of-the-art against backdoor attacks on clean data. |
Comparison of Conventional Hybrid and CTC/Attention Decoders for Continuous Visual Speech Recognition (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances have been achieved in Visual Speech Recognition (VSR) despite the lack of data, there is no clear comparison between different types of decoders for certain languages and tasks. |
| Approach: | They focused on how the conventional DNN-HMM decoder behaves depending on the amount of data used for their estimation. |
| Outcome: | The proposed model improves the CTC/Attention model in data-scarcity scenarios while requiring less training time and fewer parameters. |
End-to-End Sequential Metaphor Identification Inspired by Linguistic Theories (P19-1)
Copied to clipboard
| Challenge: | Existing sequence tagging models do not explicitly exploit linguistic theories of metaphor identification. |
| Approach: | They propose to exploit linguistic theories of metaphor identification in deep neural networks to improve model performance. |
| Outcome: | The proposed models achieve state-of-the-art in end-to-end metaphor identification on three datasets. |
A Geometry-Inspired Attack for Generating Natural Language Adversarial Examples (2020.coling-main)
Copied to clipboard
| Challenge: | Existing techniques to generate adversarial examples for natural language are limited . previous research on adversarials focused on images, but this is not the case with natural language. |
| Approach: | They propose a geometry-inspired attack for generating natural language adversarial examples . they use deep neural networks to iteratively approximate the decision boundary . |
| Outcome: | The proposed attack fools natural language models with high success rates while replacing a few words. |
Towards More Accurate Uncertainty Estimation In Text Classification (2020.emnlp-main)
Copied to clipboard
Jianfeng He, Xuchao Zhang, Shuo Lei, Zhiqian Chen, Fanglan Chen, Abdulaziz Alhamadani, Bei Xiao, ChangTien Lu
| Challenge: | Existing models of uncertainty score depend on winning score, which is the maximum probability in a semantic vector. |
| Approach: | They propose to generate accurate uncertainty score by improving the confidence of winning scores by reducing the effect of overconfidence of winning score and considering the impact of different categories simultaneously. |
| Outcome: | The proposed model reduces the effect of overconfidence of winning score and considers impact of different categories of uncertainty simultaneously. |
Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a key task in NLP to find mentions of named entities and classify them into predefined categories. |
| Approach: | They investigated the impact of data augmentation on confidence calibration and uncertainty estimation in Named Entity Recognition (NER) tasks. |
| Outcome: | The data augmentation improves calibration and uncertainty in cross-genre and cross-lingual setting, especially in-domain setting. |